1 link tagged with all of: chatgpt + evaluation + personal assistant + benchmark + openai
Click any tag below to further narrow down your results
Links
OpenAI introduces LifeVal, an evaluation of everyday practical tasks like finding housing, managing budgets, accessing government services, and shopping, which the company used to track ChatGPT's progress over the past year. The goal is to measure whether AI can take actions that actually get things done, not just give advice.
- The tasks were chosen from areas where users most want help: caregiving, health, education, household administration, personal finances, shopping, and government services.
- The benchmark tests action-taking, such as adding a deed to a cart for review, rather than only chat-style answers.
- OpenAI says it has used LifeVal to track and drive model improvement on everyday tasks over the past year, and frames it as a step beyond academic knowledge tests.